MDM CM Extract Outbound Views

Prerequisite

Area

Prerequisite

Task Group Execution

Reltio_MDM_Extracttask group must be executed successfully at least once.

Start object type data and End object type data

Once the Reltio MDM extract process is completed, make sure that the start object type and end object type data is available for relations data in staging table's (ODP_CORE_STAGING.@ReltioConnectionName_RELATIONS) json message. If it is not available, contact Reltio support team.

Create a Task Group for CM Outbound Data Views

To extract the outbound views, you need to first create a Task Group in IDP OA platform to execute the extract process. Follow the below steps to create a task group in IDP OA.

  1. Using WinSCP or s3 browser, connect to the IDP default s3 bucket and go to the folder <bucket_name>/templates/product.

  2. Find the template Reltio_MDM_CM_Outbound_Dataviews__<version>.json and download the latest version template to the local machine.

    Open the pipeline template Reltio_MDM_Outbound_Dataviews_<version>.json in any text editor and replace all the occurrences of below place holders.

    Placeholder Replaceable String
    <RELTIO_CONN_NAME> Reltio Connection name configured in Entity Collection. For example, RELTIO_MDM

  3. Login to IDP OA platform and under the Data Management section, click Data Pipeline.

  4. On the Landing Page, click Data Pipeline again. The Task Groups page appears.

  5. Click Task Group from Template, select the latest downloaded template Reltio_MDM_CM_Outbound_Dataviews__<version>.json and then click OPEN.

    Verify the Parameters

    Verify the taskgroup parameter EntityTypeList and add reltio entity types if required. Only those entities information and it'srelated relations/merges, which are configured as part of this parameter EntityTypeList is available in outbound views. To add a new entity type to this parameter, add a comma (,) followed by entity type enclosed within in single quotes ('') and save the task group. Do not remove the already configured baseline entity types.

    If you want to extract combined Customer and Payer data, set the PayerEntityTypeList parameter value as null (single quotes) '' and then run the MDM_File_Extract_Customer pipeline. See the figure below.

    If you want to extract Customer and Payer data separately, set the PayerEntityTypeList with Payer Entities such as Company, Formulary etc and then run the MDM_File_Extract_Customer_V2 and MDM_File_Extract_Payer pipelines. To add a new entity type to this parameter, add a comma (,) followed by entity type enclosed within single quotes ('') and save the task group.

    Create Outbound Views

    1. On the Task Group page, find the task group Reltio_MDM_CM_Outbound_Dataviews and then click RUN.

    2. The task group status will be ExecutionInProgress while the data is being extracted and status will be displayed as ExecutionCompleted once the extract process is done.

    3. The Outbound Dataviews are now created for Healthcare Master, and you can extract the data from outbound views into flat files.

    4. To know the execution details, click the three vertical dots beside RUNand then click Show Execution Logs from the drop down as shown in the figure below. 

    Task group Reltio MDM CM Outbound Dataviews should run only in the below scenarios:

    • When imported for the first time into an IDP environment.

    • When a latest version of this task group released in the subsequent releases.

    • If any changes made to the definition of underlying views or views by client teams.

    • If underlying views are invalid.

Conversion of Materialized Views to Views

To handle the cost consumption, all the Materialized Views are converted to Views in Reltio MDM CM Outbound Dataviews pipeline starting from V11 release.

From V11 release, the user has to RUN the Reltio MDM CM Outbound Dataviews pipeline at least once to convert the Materialized Views to Views. See the below procedure to verify the converted views in snowflake.

Verify the Converted Views in Snowflake

  1. To verify the views that are converted from Materialized Views to Views, login to the Snowflake database with valid credentials.

  2. Run the below Query with the Reltio connection name that you want to verify to fetch the results. See figure below.

The data model table will be displayed as shown below. Navigate to the column is_materialized to check the status.

The coulmn is_materialized will display the status as false which indicates that the Materialized Views are converted to Views.

 

Data Interface Document

For more information on DID for Customer MDM Outbound Extract,refer Data Interface Documents.